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Numbers and Words: Combining Quantitative and Qualitative 


Methods in a Single Large-Scale Study 


. 
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The history of methodology in social and educational research reveals 


, 


.a vacillation between qualitative and quantitative approaches. Prior to 


ry 


World War II, field work dominated with the primary data sources deriving 
Ww : 


from’ interviews or participant observation. With the advent of public 
oe 
opinion polls and market research, reliance shifted rapidly to quantitative 


methods and ay approaches dis vantiioutae. A polemic quickly arose 

‘ between the two-camps that engendered an "either/or" debate. Many 
researchers. took the stance that chet trade vas 4 single-method enterprise 
and made vigorous ee for and counter-attacks against each 


perspective. ‘The debate continues even today, as one observer notes, 
, ; 


". .the actual divisions are fore notab 


‘ 6 


le than the possibilities for 
unification" (Smith, 1983). . | 

There has been a great deal written sheik the battle between methods. 
This paper is an attempt to synthesize some of the more eeiant points’ * 
from that literature, ‘elaborate our erependie on combining methods, and 
describe how it can be done by using examples from one the dagaeiy r arch 


aod 


project. 


. Three Perspectives 


- - v 


Using qualitative and quantitative methods in a single .research 


‘project has been the subject of controversy. Often confused and ambiguous, 


e 


the debate is hindeved by infrequently defined and overly broad concepts. P 


At times the arguments rage at the paradigm level; at others, the concern 
fr . 


obi? 
4 


“is with research etrategy; and at still others, at the level“tf data 
Mare” 


* * ‘® z 
ae 
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at 


collection techniques and types of evidence. The debate crosses *levels ¢ 


capriciously, leading to confusion and frustration. However, thrce 


af 


~ dfstinct perspectives about research strategies have emerged. At the risk 


of over-simplifying, we refer to these as the purist, the situationalist, 


a 


as and the pragmatist. 


: “Purists usually argue at the paradigm level and hold that qualitative . XX 


’ ¢ ° 
» v ‘ 


and quantitative approaches derive from different, mutually exclusive 
4 epistemologic and ontologic assumptions about the nature of research and 
sotiety (Burrell & Morgan, 1979; smith, 1983; Collins, 1984). Smith. Ht re oe 
+6 - (1983), thersiote, argues that the two approaches cannot be combined. 
Burrell and Morgan (1979) assert that dbtferent ica are “mutually C 
exclusivé....a synthesis as not possible, since in hei pure eta they a4 


® 


are contradictory, hetae Naaed on at least one bet of opposing 


meta-theoretical assumptions" (p.25). These assumptions, moreover, have 


direct methodological implications: ° 


‘ 3 = Y ¢ 
It is possible, for example, to identify methodologies employed 
in social science. research which treat‘the social world like the ‘ 2 


patural’ world, as being hard, real and external to thé = =e 
" individual, and others which view it as*being of a much softer, 
personal and more subjective quality. (Burrell & Morgan, -1979:2) . 


Hard>ar soft? oa or qualitative? Assumptione about. knowledge ~ F 
and social Poality lead ene to one orsthe ather nethodolepy: 
This perspective views hee 3 science research as a dichotomous 
7 . ° i oY 


gadeaver. Naturalistic inquiry. represents one extreme position; little ' 


manipulation of the research conditions charatterize this appréach. 


* 


a L . Experimental inquiry exemplifies the opposite extreme where all conditions . 
. : are tightly controlled and the information to be ‘collected is highly «> 

structured. : : é 
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Situationalists focus on methodology and maintain that no singleF 
Lowa i ‘ = ° 
technique can lay claim to a monopoly of inference. They assume that data 
4 A . 


collection techniques and “pee of atten flow logically from a 
particular fietheddlnays A scien generates quantitative data while an 
ethnography resulta in qualitative data. Although both approaches may be 
‘used in a ‘study, it is still felt that certain kinds of data are 
appropriate for specific situations, “For example, in the Rural 


t 
Experimental Schools study both survey and ethnographic approaches were 


used, _In reporting the study's results, each component is presented dad 
discussed separately. The quantitative data 4 reported in Resenb dim and 
Louis (1981) while the qualitative data are reported in a variety. Of places 
(see, ae Firestone; HgE8) Sind larly, in a study of Thai education, 
Fry, Si eke ater and Bhasedanael (188) suggest’ using survey Sat ° 
demographic analyses to select axtrewd cases for in-depth ethnographic 
study. These two seagiek are ‘typical of the situationalist perspective 
where each method is used for a spdettitec purpose; true intepeeetnrt is not 


realized. : Pm oe . és 


~ 


This view has ‘led, to attempts to establish criteria for judging when °° 


to collect each (Zelditch, 1962). Even that ‘attempt at rapproachement 
a i] 


still adheres to the beliefs that one should use either one method or 


another and that the situation dictates when to use each. The two 


approaches are viewed as “complementary" (Widich and Shapiro, 1955:33), but 


still as representing distinct universes. 
Little integration is fostered by éither the purist or the 


situationalist-view. Not so for the pragmatists who argue for the 


a 
ry ; 


integration of methods . in a single study. Sieber (1973:1337) summarizes 


the case for such a perspective: "If each technique has F inherent 
i] 


- ~ 
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weakness, it also has an inherent strength unmatched by other techniques." 
® ‘ ‘ Cee ‘ ‘ 


° 


The trick is to tap the relative strengths and to make the most efficient 
use of both in at tempting to understand social pkenonefia. Sieber (1973) 
and Madey (1982) outline how qualitative and quantitative methods can 
contribute to one another in, the design, data collection, aud: analyeda 
phases of a project. Similarly, in a diuajeeiun of evaluation esearch, | 


& ad 
Reichardt and Cook (1979) describe how combining methods can (1) answer 


multiple research questions, (2) allow each method to build on the other, 


and (3) triangulate one with the_other thereby overcoming the inherent 


e 


. j ; 
biases in each. i 4 


» I. - 


While discussion on combining methods can address a number of key 


t 


issues ranging from design to analysis, we will focus only on analysis. We .. 


address this issue because all too often researchers gloss over the 


critical analytic phase and show the combining of methods by demonstrat ing 


- 


. ‘ 2 rf a 
hint “Gua lie peive data "enriched" survey information, or that 
qualitatively-derived hypotheses were tested out through subsequent 
quantf{tative data’collectiom and analysis. We claim that each type of’ data 


cart play a critical'-role’in several phases of analysis. 


_— 
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: Analysis: Corroboration, Elaboration, Initiation 


rd 


Ultimately, combining methods in a single study is triangulation. 
Defined by Denzin (1978:291) as "the combination of methodologies in the 
; i ? pe 7 


study of the same phenomenon," triangulation allows tiie researcher to | 


improve the accuracy of conclusions by relying on more than one type of 


data. Jick (1979) describes types of triangulation design ranging from 


* 


° . 
* ° . e 


. 


« 


% 


simple to, complex. The simplest form is the within-methods design that 


include scaling or multiple comparison groups to test for the reliability , 


- : of findings. Somewhat more sophisticated is the between-methods design . P 
that tests for convergent validity. Jick (1979:603) notes that this design 
is "currently the archetype of triangulation strategies." It brings’ “ 


together data auitected through more than one method to see if there is ’ 
-* ‘ Rar Ps 


- 


. convergence in the findings. We describe this function as corroboration. 
A second between-methods design allows one type of data to elaborate~ 


the findings of the other. Elaboration provides richness and detail. It 


expands understanding of the phenomenon studied through refinement and . 


it 


development. Although Jick dismisses fiis function as often — ‘, 


"parenthetical, even somewhat patronizing" (1979:603), when each data type © 
t . ‘ 
is well-developed, elaboration can lend strength to an argument and provide 


« a 


,» a different »perspective on the same phenomenon. ‘ oa 


The most complex design, holistic or contextual, goes beyond scaling, 
i * a . ~ 
reliability, or convergent validity. This design seeks to uncover 


. . variance. Jick (1979:603) notes that. "it is here that qualitative methods, 


“in particular, can play an especially prominent role by eliciting data and ~ 


° 


: \ 
suggesting conclusions to which other methods would be blind." Because 
holistic triangulation is divergent, seeking variance or areas where 
findings do not ‘converge, @t can initiate interpretations and conclusions, ae 


suggest areas for further analysis, or re-cast the entire research 


question, ‘Rather than seeking confirmatory evidence, this design searches 


- 


¢ 
= for divergence. 


fhe view adopted by most of the research community is -that 


quantitative techniques are the most appropriate source for corroborating - 


’ 
& 
s . . : “ 


4 : i ‘ ; 


id 


~ a - aie 


findings {initially noted from qualitative methods. Likewise, qualitative 


° 


methods are best used to provide richness or detail to quantitative © 


3 . 
findings (elaboration), but should precede quantitative ones when 
| y 
clarifying the direction of inquiry (initiation). Thus, convention: would - 
have one method precede the other during the analytic process, depending on 


whether the researcher's intent is corroboration, elaborationy or 


‘initiation. We argue that both methods can work spirally (sometimes 


‘ ’ « 


upwards, sometimes down), .and iteratively “derive 4 more complete 


a 


understanding ofthe phenomenon in question. It is the ‘contention of this 


s . 


paper that both methods can be used fruitfully for all three functions’ and 


' 


. 


that neither necessarily takes precedence over the other. 


< : 5 : . H - . _ : 
Background of the Study m 


; , YY 
The study from which examples have been selected to illustrate how. ~ 


e 


both quantitative and qualitative methods can corroborate, elaborate, and 
initiate findings from the other method. was a large-scale, three year study 
of regiona] educational service agencies (RESAs)*. RESAs are agencies 


located between the state education agency and local school.districts. 


' 


. They are organizations that have recently emerged to provide a variety ‘of 


"services to groups of local school districts within a geographic area that 


) 


“would not be available if. districts worked independently (Kimberly, ° 


Norling, & Weiss, 1983) ,. Data were collected from the agenciedand their | 


clients, the local school districts, to learn mare about the process by 


which new knowledge is disseminated to. schools and how’ RESA services 


support school improvement programs. The data collection methods included 


s 
v a . 


surveys as sources of quantitative data and open-ended interviews and 
? . 


to 


<? 


- 


‘the RESAs using survey data, 


, 4 
reviews of documents: as the primary sources of qualitative information: In 
- & ‘’ . ‘ 


the following, section specific examples are used to illustrate the 


s fe - a 
potential for both quantitative and qualitative data sources to *. om 
; eo” : 
‘sorroborate, elaborate, and initiate. - *s ‘s 
7 ; ¢ 
e : : ' 


Corroboration:- ° 


= ie , n) 


-Corroboration seeks a convergence in, findings; that is, jts purpose is 


to confirm or. disconfirm established results. New perspectives or 


4 


‘ . 4 o . , 
enriching detail are not sought; instead, the goal is to support an . 


2s 
argument. In the following ,two examples, we show how each data type can be 


used to corroborate findings from the other. 


ES 


o 


Qualitative Supporting Quantitative. ; : 5, 


4 


In the study RESAs, a survey asked school administrators (1) low 
a ; e 
helpful their RESA was in activities like assessing district goals, 
identifying new curricula or -instructional approaches; and achieving 


significant cost savingag (2) How RESA staff performed certain training and ; 


‘assistance roles in the field; and (3) what percentage of ‘contacts with the 


RESA were initiated by the agency. The RESAs at opposite extremes were’ 


selected for case study: Farmland (a pseudonym) ranked first of‘ eleven in- 


a 


~ helpfulness and training emphasis, and second in initiation, 


Rural-Industrial, in contrast, ranked ninth in helpfulnees -and initiation, 
4 ‘ { . ay & 
and. last int training emphasis. Having established the differences between C 


' 


* . 


° 


‘we analyzed open-ended .interviews conducted ~ .” 


ro 


with these same administrators to see if the: differences ‘were supported or, 


ftsconfirmed. Farmland was characterized as extremely helpful, innovative, 


al ° 
‘ 


and entrepreneurial. The interviewees felt that: 


~* 


€ 
" 9 
‘ 
’ 
4 
. 


. . 


 " The*RESA's image is very "positive ae superintendents’ apd 


professionals, There are structures that SUpPOEE uh  * 
Ld ° 
1 go to the RESA because 1 have faith in those people as the best 
place to get ‘the answer. .. ‘ . e - 
Rural-Industrial was desctibed as not much help and’ as not shaving any f 


curriculum service. One school administrator remarked that: 

- Other than in the areas of service to eaeaeloned and. special ed * 

“ students, there are no advantages from the RESA...but the bulk of 
‘students are not Bie ed and voc ed, . 


t NG : 1" , : 
Thus, interview data were used to corroborate,the idea that the two 


RESAS were percefved differently. In this case, the, quantitative data’ * 


“drove the selection of agencies -for case study and built the initicl , 


~ 


argument about variation in-service orientation.* Qualitative -data were ™ 


. ° . 
“then used to lend support to the argument--to cyrroborate from an 
a é, ee ~*~ . i ’ 


Quantitative Supporting Qualitative 


additional data source that variation existed. ’ 
eer ae : 


, . 


- 


Using data .from RESA field ‘agents, we argued that agint’s used two - 


° 6 


strategtes “for prdmoting reform ii education; one emphasized Naetepance 


while the other relied on enforcement. The strategy. of assistance required 


‘ 


dissemination systems that put human helpers in contact with school systems 


> to iricrease their access to legal and program knowledge needed to operate 


a’ 


2 
successful PrOgrants The strategy of enforcement involved the use of 
regulations and mandates -to promote reform in education, This latter 
strategy required close sonttoting of school system activities to ensure 


5 - ‘ 
that mandates were properly implemented. aos eo 


. 


we 


nn ae z * ~ 
. ‘ ‘ ° dey Le ecg ° * 
; sos 8 Ad 
« . ~ . rz zs a get : 
; os Owr assessment of which agencies played what role begay with a 
e qualitative ‘review of the ‘missions of the agencies in-our sample. The ‘ 


results. of that envied andicated that some RESAs promoted the image of © 
, 
general sacate ia agencies, providing help in-many areas, while others 
a td 
focused their assistance more specifically on the provisién of knowledge 
ee = id * = . 


through training and technical assistance. Still a third set of RESAS 


operated as‘branch offices of the State. Department of Education ‘and their 

responsibility was primarily regulatory. They were responsible for 
ae ; : s Pee ale 

ensuring that school districts followed a.state-mandated planning process, 


and that students achieved above minimum criterion levels on a basic skills 


test. “Thus, the qualitative analysis suggested that two types did ? 


‘ 


assistance work and that one focused primarily on enforcement activities. 
- This assessment was then corroborated by the gquantitative data. Field 
agent surveys in each of the agencies. (N=138) indicated the extent to which 
uo? . . . 


they played eleven different roles: A factor analysis of those roles 


” s 


revéaled two factors that matched our assistance and enforcement — 


. . a ‘ 
‘distinctions. We then created scores for each individual which represented 
¢ ae v 


. 


the two strategies of assistance and enforcement. Individual scores were 


‘aggregated for each agency and a bivariate plot of the mean agency scorés 


revealed fwo distinct clusters, The first cluster scored high on 
enforcement activities and low on assistance while the second tevealed the 
opposite pattern. These plots supported our qualitative identification of . 


» ; ' 
which agencies were of what type. Thus, the quantitative data were used to. 


support the initial findings jeriving from qualitative seurces. , 
4 * . 4 


. 
, 


Elaboration © 
Hist sewtton provides eichnews and detail. The usual image is of 
\ "fleshing things out" or "putting meat on the bones." Typically, 
qualitative data are used to enrich the bacechones of statistical results. 
; In the following sxaanleal we show that elaboration is a tuowmay ‘attest, 


While rich description undoubtedly enlivens means and frequency 


3 


’ distributions, quantitative information can also add greater depth of 


understanding to qualitative results. 


Qualitative Enriching Quantitative , ’ * 


RESAs were iqphebant cuwsienta for helping educators cope with, a 
variety of pressures from an increasingly complex environment. They do 50° - 
by performing two functions: political and technical linkages. Thedp two 
functions were distinguished by both their fontent and process. Political 
linkage dealt with knowledge about regulations and legislation: what - 
decisions were being scuetiivead and which outcomes were likely, what 
vecisions had been made and what they meant, sid Sate inportant--what 
opportunities aii consthainte these race aah created for locag school 
PECRES: Political Linkage was a idan aenieee by clarification and 
A negotiation as cncivadoals tried -to ensure that the oe advantageous. 
interpretation of a nandate was made both while it was being formulated aia 


- 


as it was being implemented and enforced. ‘On the other hand, technical 


jAnkage dealt primarily with knowledge about curriculum and instructional 


practice: what should be eauuhe and how. The technical TEARS process 


» 


entailed Tearning and select ings identifying new practices or concepts, 


my 2 


° 


ay 


ants 


: / 


& 


selecting ideas for local use, and developing the skills to put them into | 7 


practice. . ak M opt 


“To test whether field agents in the RESAs under study actually ; 


per tonned PheRe two linkage roles, we gave respondents a list of role 


deseniatons ie asked them to tadieste the extent’ to which cee | 
. each. Responses to these questions were Suey factor avalon to determine 
whethae sets of items came together in asnesene roles similar to what was 
hypothesized. That quantitative assessment revealed three distinct roles. 4, 
v The first, an expert/trainer, wa defined as a apeotalier in a specific area 
who made aa available to schools through workshops, inservice, and 


4 
more sakwpeivy consultations, This role fit closely with the theorized : 


eit function. The wand role, liaison, was defined as a go-between 
: who did sik provide knowledge directly, but who helped schools diagnose 

problems, find resources, and match appropriate clients with resources. 

This role combined both ‘political and technical functions. The third role 


s 


» which we labeled the monitor was closest to what we meant by the political 


linkage function. We defined a monitor as someone who collected 
‘4 aan oem Lott from schools to determine their compliance with law and code. 
We then used the factor analysis results to guide oumgxamination of | é 
the qualitative interviews with the same field agents. We were able to 
™ build a much richer description of what was meant by each of the three ~ 
roles and how they fit into the two theoretically defined functions. For 
“each role type, we selected the highest scoring field agents and then 
reviewed their interviews to broaden our understanding of the role types. 
We used responsés to an open-ended interview question which asked | 
informants to "describe what you do in your field agent role." These 


_ ® 


~ ». -s “ 
cat a a = any 


\ ; ee 


be, 
qualitative results clurifted and expanded the definitions of each? role 


type initially derived from quantitative analyses. 


i 


Quantitative Enriching Qualitative i 


One of our intentions was to describe RESA services from teachers’ and | 


| 
i} 


administrators' viewpoints on three questions: (1) how were services \ 


delivered to local educators; (2) in what content areas were services 
a ; 


provided; (3) what explained a successful assistance relationship? The 


data used were primarily qualitative, although eurvey data were uséd as 
elaboration thraughout. 
The interviews with district aduinistrators and our previous knowledge 


about RESAs suggested that services were provided in five different modés: 


long-term project assistance, -workshops, brief interactions, telephone 


contacts, and use of the resource center. Although we described these 


‘ 


types of services using extensive quotes from the interviews to paint a 


. « 


picture of each service, we included survey data indicating over-all 
trequency of this type of activity. Hare ‘the quantitative data were used 
ee our initial impressions of, patterns of use. 

Having established the type and genersl frequency of services, we 
analyzed the survey data to see how consistent these patterns were for 
different ‘categories of school personnel. This analysis revealed that = 
administrators received more setvices from their RESA than did teachers. 
Most dramatically, administrators were in touch via the teleplione ver ten 
times more often than teachers. This finding suggested that 
administrators’ greater involvement was largely to arrange long-term 


projects and to have questions answered quickly. Teachers apparently did 


1d 


12 _ i 


not have the same informational needs. The survey data thus elaborated the 
interview data, providing a richness of detail about differences between 
teachers and administrators that the diaidvar ive data alone could not 
provide. . 

In this example, qualitative data provided the evidence for an initial 
categorization of service types. These were then elaborated across types - 
of school personnel through the survey data. The quantitative data ptisa 


Oe, 


provided a more detailed and varied description than the interviews alone. 


Initiation 
Initiation is the analytic function that turns ideas avound: It-- 
initiates ned interpretations, suggests areas for further exploration, or 
re-casts the sitive research question. In the two examples below, one data 


source initiated new interpretations of the other. Initiation brings with 


it fresh insight and a feeling of the creative leap. 


Qualitative Interpreting Quantitative 


Using survey data, we found that looking for training and technical 


7 assistance was more an administrator task than a teacher task and that °.. 


“ 


administrators searched for help from sources inside their districts and 
outside about equally. This finding was somewhat surprising because our 


-sample had purposively selected districts that were frequent users of one 
f 2 o—- 
external source--their RESAs. We had expected more external searching than 


4 * 
internal. We also found, using tHe survey, that RESAs seemed to specialize 


and that district contacts with the RESA fell into regular patterns. To 


broaden our understanding of this patterned external searching, we turned 


. 
e 


to the interviews for possible interpretation. We. wanted to understand how 


discerning the search among assistance agencies was. oe 


The qualitative data suggested two categories of behavior. The first, 


"the shoppers," had the resources and discrimination to select the most 
oe 
appropriate source of assistance for a given purpose. For example, one ° 


interviewer described his shopping behavior as follows: 


University of Pittsburgh-~proximity, we know people on the staff, 
they have recognized leadership in the Department of Ed, we have 
done work with their Reading Department. Carnegie-Méllon--they 
have a teacher training center, cne teacher went there for 
training. LRDC--for secondary’ed, we participated in some 
studies....The IU--when we need inservice training and provide 
resources. We are members of a curriculum council and share what 
we are doing in that field and on the school improvement plan. | 


The second, "the loyalists," tended to rely on a single agency--the - 
RESA--although that loyalty was relative. “One admin{strator said that he 
turns: 
a x e nal . 
..primarily to the RESA. That's the first point of inquiry. If 


the RESA can't respond, we go to others, often through the RESA 
‘reference bank. : 


e 
. e 
~ 


Loyalists tended to go to their favored RESA first or for a referral to 
another agency; chy didn't rely on the RESA éxclusively, When they were 
unable to select an assistance agency themselves, a turned to the 
_ RESA--an agency they knew well or that kiew them well--for assistance. 
In.this example, general patterns of apedetance seeking were described 
through the quantitative data. The questions answered grew in complexity 
from a distinction between administrators' and teachers’ auiiebeney * 
searches to percentage of external and internal searching to dicepiuieden _ 


among external sources. Then, insight, into this external search behavior 


was provided by the qualitative data. - 


14 
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Quantitative Interpreting Qualitative 


Our itijea from the field agent sekeion of the study suggested that 
‘there were two strategies for sieanetnh reform in education--assistance and 
enforcement. Our interviews with field agents in agencies most responsible 
for enforcement activities revealed an ambivalence about their role. The 
qualitative data clearly indicated that they were uncomfortable with the. 
enforcement .aspect of hehe work. At the time of vite ee staff totaled 
155 professionals apaniatle for the activities of $73 operating school 
distepets and had a broad mandate to monitor compliance with state-mandated 
slanting procedures, ee teacher evaluation regulations, building 
codes, ‘and budgeting procedures, as well as federal laws. They were also 
aapectet to visit all 2411 schools in the state at least once a year. As a 
result, their monitoring burden was substantial. Yet, the Oe eee 
suggested that many of them tried to downplay their enforcement role: 


The primary thought in our work is not to act as a, monitoring agent. 


I don't do checklist monitoring. I feel more like a TA person. I 
help districts identify needs. ° 


In fact, some were actually trying to define their work as assistance, as 
these quotes suggest: : i 
In the internal kind of work we do here, we try to provide service 
kinds of activities €o local districts in terms of helping them meet 
all of the state and federal requirements fer alJ: the kinds of school 

programs that they offer. : 


A lot of my time is spent on the phone answering field questions. - The 
rest of my time is spent doing policy clarification and giving 


ie” solutions to problems in meeting state guidelines and mandate for. 


special education. 
Ps : : - 
A clue to why field agents sought assistance roles when the agency 
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_mission was one of enforcement is offered by one interviewee: 


-“~ 


lam. viewed as an adjunct member of the management team the local 
school district. In some cases I give workshops, but I usually serve 
an adminjstrative role in the district. 


e 


A full explanation for this emphasis on assistance c ..es from the 
jaeienb ive data and shows how quantitative st det be used to initiate 
new understanding about a relationship that was initially -suggested by the 
qualitative data. An important ‘reason why enforcement staff downplayed 
that aspect of their work was that they were recruited. from the population 


they knew. Evidence of this came from the survey data. Analysis of 


demographic data in the survey indicated that 83 percent had worked as 


. either teachers or administrators in schools. Moreover, they came from the 


ty 


very geographic areas, they now were monitoring. For example, over 


% 


two-thirds of the field agents who scored high on monitoring reported that 


‘ their higher education training was within commuting \distance of the region 


e 


they now served. This is in comparison to less than half of those who did 
not report doing enforcement activities. We also created ae. 
iocal/cosmopolitan index (Gouldner, 1957) °that expressed the proportion of: 


field agents' work experience as a ratio of within-region to outside-the= 


« ~~ 


state. Those who reported high enforcement activities had statistically 


‘ . & * 
significant higher localism scores than t! ose who spent more time on. 


¢ 
\ 


assistance activities. This collection of quantitative data initiated an 


interpretation that helped us understand why the enforcement strategy as 


4 


defined by the qualitative data was being downplayed by those who were 


¢ 


expected to fulfill it. ~- P 


. 


_jl6 - 


4 


oe 


: . : Discussion oe 

ez . » 

We age pragmatists, and our over-riding concern throughout the 
wk 


. analytic phase of the study was to. maximize systematic understanding of the 


role of RESAs in promoting knowledge use among local educators. The 


« A) 
examples we have offered may suggest that the process of combining methods 


is straight-forward and relatively simple. To avoid misleading the reader, \_ 
we feel we should describe several conditions supporting the research that 
gave us time and opportunity to allew the two data sources to interplay, 


o 4 


First, the study design was exploratory and complex. The exploratory 
_ “ patute allowed us to develop erry research questions as analysis 
proceeded and granted us room to play with the data, promot ing the 
integration of analyses from both sources. the ebaplentiy of the design 
ensured that we had data on a variety of issues. From first conception, 
the study was grounded in theories of knowledge use and complex 
eveintenttonss and research traditions in policy implementation, 
educational change, and innovation. These conceptual frameworks were | 
--balanced by the practical ‘concerns and interests of policy*makers, RESA . 
leadership, and Sur own organization's ppiicitiee: This helene at 
tension, between theory and practice dictated a design that Was 
duchodologivalay sound and responsive de pcaeetoal senewent Yet when we 
° began the study, little was known shout RESAs. The exploratory and sda 
design maximized the possibility of systematically collecting various‘ sorts 


” 


of data while allowing the unexpected or novel insight to be uncovered. ‘ 
And practical concerns led to the need for a large-scale -tudy. 
‘A large-scale study requires large-scale resources. The second 


condition that supported the integration of methods was, then, resources. 
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Mostly, we had time. Although we operated with deadlines TOE discrete 


phases of the analysis, we had room to experiment. Guided by several broad :- 


topics, we had latitude in framing specific questions to help focus 
analysis. ‘We conducted. analyses separately, allowed results from one to 
trigger ideas for the other, worked independently and interdependently.. 


None of this would have been possible without time, and we believe it is a 
crucial condition for exploratory research. ee 
Third, we respected each other's methodologic’ training and sencretan, 
One of us was trained quantitatively, ana cches qualitatively. Yet our ~ 
orientations to research were sensitive to the potential of each approach, 
a Thus we had a design that fostered exploration and experimentation 


both in specific research questions and in combining data sources; we had 


the luxury of time to develop leads and uncover areas of possible 


the project as a purist--we both knew the potential of the other's domain 
“to further understanding of social phenomena: 
Clearly, we believe that jadbiting methods is productive. For 
example, one goal of the study was to increase knowledge about school 


improvement approaches and general assistance activities preferred by local 


, educators. This knowledge would be useful to our organization in planning 


4 


“its dissemination activities, to state departments of education, and to - 


RESAs themselves. Using only one data source would-have provided limited 
information about the variety of services e@cators want. We were also 
able to explore fully the tensions created when states rely on enforcement 


- 


tactics--negative sanctions--to promote change. Using only qualitative 
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k - | 
, collaboration; and%we got along with-each other. Neither*one of us came to 


2 : 4 ; 
data would have severely constrained our understanding of the conflicts 
experienced by field-agents charged with enforcing law and code, . 
Both the purist and the situationalist perspectives foster the idea 
that id eieays and ‘quantitative data should be kept separate, each 
sees discrete purposes. The purist would have them in subieels 
different studies, while the situationalist ui place them side-by-side 
in the same’ study. Rather than uding hie seqneek ae actualy exclusive 
ways of knowing, we explored ties they could Be more fully integrated. 


Numbers and words can work together to produce richer .and more insightful 


analyses of complex phenomena than could either one alone. 


be 
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; 4 Notes | ’ 

t - ® 
1. ‘The distinctions between basic research, applied research, and 
evaluation research are as controversial as the debate between “hard"and 
"soft" methods. We will not ‘enter into that discussion here, - 


- 2... A review of the ‘overall project and a summary of findings from the 


multiple research reports can be enued in Firestone, Rossman, &-Wilson  . 
es ' , 


“4 
a 


eee Field Spante are those individuals responsible for providing training 
and technicel assistance to local school GtePE ERs 4 


